Gemma 2 is here. The architectural tweaks are what matter.
Google released Gemma 2, an open model family with 9B and 27B parameter sizes, featuring architectural changes like hybrid attention and Grouped-Query Attention for improved inference efficiency. The …